Formulation of the uncertainty relations in terms of the Renyi entropies 
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Quantum-mechanical uncertainty relations for position and momentum are expressed in the form 
of inequalities involving the Renyi entropies. The proof of these inequalities requires the use of the 
exact expression for the (p, (jr)-norm of the Fourier transformation derived by Babenko and Beckner. 
Analogous uncertainty relations are derived for angle and angular momentum and also for a pair 
of complementary observables in A'^-level systems. All these uncertainty relations become more 
attractive when expressed in terms of the symmetrized Renyi entropies. 
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I. INTRODUCTION 

The Renyi entropy is a one-parameter extension of the 
Shannon entropy. There is extensive literature on the 
apphcations of the Renyi entropy in many fields from 
biology, medicine, genetics, linguistics, and economics 
to electrical engineering, computer science, geophysics, 
chemistry, and physics. My aim is to describe the lim- 
itations on the information characterizing quantum sys- 
tems, in terms of the Renyi entropies. These limitations 
have the from of inequalities that have the physical in- 
terpretation of the uncertainty relations. 

The Renyi entropy has been widely used in the study 
of quantum systems. In particular, it was used in the 
analysis of quantum entanglement [11, H, S S [E| , quantum 
communication protocolsja, 0| , quantum correlations Q , 
quantum measurement [9| , and decoherence lld l , rn ulti- 
particle production in high-energy collisions [ll|, [ij, [3 , 
quantum statistical mechanics |14| . localization proper- 
ties of Rydberg states 15 1 and spin systems [H, Il7|. in 
the study of the quantum-classical correspondence p^ . 
and the localization in phase space [l^ . In view of these 
numerous and successful applications, it seems worth- 
while to formulate the quantum-mechanical uncertainty 
relations for canonically conjugate variables in terms of 
the Renyi entropies. I do not want to enter here into the 
discussion (cf. (ISjIlil) of a fundamental problem: which 
(if any) entropic measure of uncertainty is adequate in 
quantum mechanical measurements. The uncertainty re- 
lations derived in this paper are valid as mathematical 
inequalities, regardless of their physical interpretation. 

The Renyi entropy is defined [2^ as 



Hn 



(1) 



Renyi called this quantity "the measure of information 
of order a associated with the probability distribution 
V = {pi, ■ ■ -PnY^ ■ The Renyi measure of information Ha 
may also be viewed as a measure of uncertainty since. 



after all, the uncertainty is the missing information. In 
the formulation of the uncertainty relations given below, 
the Renyi entropies will be used as the measures of un- 
certainties. 

In order to simplify the derivations, I use the natu- 
ral logarithm in the definition ([T]) of the Renyi entropy. 
However, all uncertainty relations derived in this paper 
[Eqs. ©, dill), (m, (Ell), dSIl), (Sol), and g!])] have the 
same form for all choices of the base of the logarithm 
because they are homogeneous in ln(. . . ). Note that the 
definition of the Renyi entropy is also applicable when 
the sum has infinitely many terms, provided this infinite 
sum converges. The Renyi entropy ([T]) is a nonincreasing 
function of a For a > (3 we have Ha < Hp. In 

the limit, when a ^ 1 the Renyi entropy is equal (apart 
from a different base of the logarithm) to the Shannon 
entropy 



lim Ha 



(2) 



According to the probabilistic interpretation of quan- 
tum theory, the probability distribution associated with 
the measurement of a physical variable represented by 
the operator A is defined as 



Pk = Tr{pPfc}, 



(3) 
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where p is the density operator describing the state of 
the quantum system, and Pk is the projection operator 
corresponding to the fcth segment of the spectrum of A 
(the A:th bin). The uncertainty is the lowest when only 
one Pk is different from zero — the Renyi entropy reaches 
then its lowest value: zero. 

The probability distributions p^ and p^ that corre- 
spond to different physical variables but to the same state 
of the system are, in general, correlated. These correla- 
tions lead to restrictions on the values of the Renyi en- 
tropies Ha and Hp . When these restrictions have the 
form of an inequality Ha + H^ > C > 0, they deserve 
the name of the uncertainty relations because not only 
do they prohibit the vanishing of both uncertainties for 
the same state but they also require that one uncertainty 
must increase when the other decreases. 

In the present paper, I derive the inequalities for three 
pairs of observables: position and momentum (or time 
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and frequency), angle and angular momentum, and the 
complementary observables — the analogs of x and p 
— in finite dimensional spaces. These inequalities are 
generalizations of the entropic uncertainty relations es- 
tablished before for the Shannon entropies [23,, |2^ . 
There is some overlap in mathematical derivations [espe- 
cially in the extensive use of (p, (7)-norms] between the 
results presented in this pap er and the earlier works of 
Maassens and Uffink [26|,[27| and Rajagopal How- 
ever, these authors did not express the uncertainty re- 
lations in terms of the Renyi entropies and they did not 
introduce the finite resolutions that characterize all phys- 
ical measurements. 



II. UNCERTAINTY RELATIONS FOR x AND p 

The probability distributions associated with the mea- 
surements of momentum and position of a quantum par- 
ticle in a pure state (generalization to mixed states will 
be given in Sec. IVip are 

Ak+l)Sp Al + l)Sx 

Pk= / dpmp)\^, qi^ / dx\^{x)\^, (4) 

<y kSp <y I5x 

where I have assumed that the sizes of all bins are the 
same. The indices k and / run from — oo to oo and the 
Fourier transform is defined with the physical normaliza- 
tion, i.e. 




From the two probability distributions ([4]) we may con- 

struct the Renyi entropies Ha and that measure 
the uncertainty in momentum and position 

= T^iKE^O - T^^KE^f) • (6) 

I shall prove in the next section that the uncertainty 
relation restricting the values of H'i'^ and i?^^"* has the 
following form: 

H«,<>,-l(J^.J^)-,„(^f),,7, 

where the parameters a and (3 are assumed to be positive 
and they are constrained by the relation 

- + ^ = 2. (8) 

In the limit, when q ^ 1 and (3 —t \, this uncertainty re- 
lation reduces to the uncertainty relation for the Shannon 
entropies 

iy(p)+iyW>_lnf^) (9) 
\ CTrn. J 



that had already been derived some time ago [25j . 

Note that the relations ([7]) and ^ are quite different 
from the standard uncertainty relations. As has been 
aptly stressed by Peres [HI, "The uncertainty relation 
such as AxAp > h/2 is not a statement about the ac- 
curacy of our measuring instruments." In contrast, both 
entropic uncertainty relations ([7]) and Q do depend on 
the accuracy of the measurement — they explicitly con- 
tain the area of the phase-space SxSp determined by the 
resolution of the measuring instruments. This aspect of 
the uncertainty relations ([7]) and ^ can be summarized 
as follows: the more precisely one wants to localize the 
particle in the phase space, the larger the sum of the 
uncertainties in x and p. 

The uncertainty relation ([7]) is not sharp — its im- 
provement is a challenging open problem. However, it 
becomes sharper and sharper when the relative size of the 
phase space area SxSp/IttH) defined by the experimental 
resolutions decreases, as it is when we enter deeper and 
deeper into the quantum regime. 

III. PROOF 

The proof of the inequality ([7]) employs the known 
value of the (p, q)-noTin of the Fourier transformation. 
The (p, (7)-norm of an operator T is defined as the small- 
est number k(p, q) such that for all ip 

\\m\p<k{p,q)mg, (10) 

where the p-norm (or the q-norm) of a function is defined 
in the standard way 

/ foo \ i/p 

mp^[j j^m^w) , (11) 

and the values of the parameters p and q satisfy the con- 
ditions 

- + - = 1, p>q- (12) 

p q 

The parameters p and q should no be confused with mo- 
mentum and position. 

The (p, q)-noTm of the Fourier transformation has been 
found for even values of p by Babenko [13] and for all 
values of p by Beckner [3l| . For the physical normaliza- 
tion (O of the Fourier transform, the Babenko-Beckner 
inequality reads 

\mp<k{p,q)U\\g, (13) 

where 

'<-)^(^)"*(^)*- 

Since the function tp can be treated as the Fourier trans- 
form of ■(/', the following inequality also holds: 

Mp<Hp,q)Uh- (15) 
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The inequalities (|T3|) and (1151) saturated by all Gaus- 
sian functions. 

In terms of the probability densities p{p) = and 
p{x) — \ip{x)\'^, the inequalities and read 



dp[p{pT] <n{a,(3)( dx[p{x)f] , (16a) 



dx [p{xT < n{a,P) / dp[p{p)f ] , (16b) 

where a = p/2, (3 = q/2, a> f3, and 

a \ -2^ / /3 \ ^ 



In the first part of the proof I shall use the inequality 
(I16ap . In order to relate this inequality to the Renyi 
entropies (O, I shall first split the full integration ranges 
into the Sp and dx bins 

oo p{k+l)Sp 



dp[p{pT^ E / dpipipT, (18a) 
dx[p{x)f= E / dx[p{x)f. (18b) 

-oo J J I6x 



Next, for each term in these sums I shall use the integral 
form of the Jensen inequality (s^ . [s^] ■ For convex func- 
tions this inequality can be stated as follows: the value 
of the function at the average point does not exceed the 
average value of the function. For concave functions it is 
just the opposite: the average value of the function does 
not exceed the value of the function at the average point. 
Since for a > 1 the function /(z) = is convex and for 
/3 < 1 the function g{z) = is concave, we obtain the 
following two inequalities: 



1 



(fc+l)<5p 



Sp JkSp 
r.(; + l)i5x 



dpp{p) 



)a 
~ Sp Ik 



{k+l)Sp 



dp[p{p)r, (19a) 



kSp 



p{x) . (19b) 



- / dx[p{x)f dx 

OX JiSx \ox Jis^ 

Therefore, with the use of the definitions of the proba- 
bilities ([ll, we may convert Eqs. p8|l into the following 
inequalities: 

oo poo 

{5pf~'^ Y.PI< dp[p{p)r, (20a) 

; J — OO 

- j dx[p{x)f < {5xf-f^ it (20b) 



These inequalities combined with the Babenko-Beckner 
result (|16ap give 

/ tx> \a I oo \T1 

[m'^'^Y.A <n{a,f3)Ubxf-^Y.A ■ (21) 



This inequality does not depend on the choice of units 
used to measure (5a;, and ft since it can be transformed 
to the following dimensionless form 



1 L (0L\ 



where 7 = SxSp/h. After raising both sides of this in- 
equality to the (positive) power a/{a — 1) = /?/(l — P) 
and with the use of the relation 1/(1 — a) -1-1/(1-/3) = 2, 
we obtain 



^ k— — c 



, l=-c 



Finally, by taking the logarithm of both sides we obtain 
the uncertainty relation ([7]) but only for a > (3. To ex- 
tend this result to the values a < /3, we have to start 
from the inequality (jl6b|) instead of (|16a|) . 

In order to generalize these results to n dimensions 
we need the following value of the (p, (7)-norm for the 
n-dimensional Fourier transform [31] 



fcn(p, q) 



2Trh 



\27rhJ 



(24) 



The uncertainty relations are then obtained in the same 
way as in the one-dimensional case and they have the 
form: 



^" +^^5 - 2U-a 1-/3. 



nln('^).(25) 



IV. UNCERTAINTY RELATIONS FOR ip AND 

The uncertainty relations in terms of the Renyi en- 
tropies can also be formulated for the angle ip and the 
angular momentum and they have the form 



Sep 



(26) 



The probability distributions pm^' ^ and pl*^-* that are used 
to calculate these Renyi entropies are defined as follows: 

p^^'^^ = |c„^ = / d^\^{^)\\ (27) 

J I5(p 

where the ampHtudes Cm are the coefficients in the ex- 
pansion of ip{(p) into the eigenstates of Af^, 



^ oc 



(28) 



k — — OG 



I— — 00 



and Sip is the experimental resolution in the measurement 
of the angular distribution. In contrast to the uncertainty 
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relation for position and momentum, the inequality (j26p 
is sharp (it is saturated by any eigenstate of M^) and 
the bound does not depend on a and [3. The absence of 
the Planck in this uncertainty relation is due to a can- 
cellation — the volume of the phase space defined by the 
experimental resolution is 5ip 6Mz — 5iph and the stan- 
dard reference volume in quantum theory is 27r?i. 

The proof of this inequality can be obtained along sim- 
ilar lines as the proof of its counterpart for x and p but 
the starting point is now two Young-Hausdorff inequali- 
ties for the Fourier series [H, H 



E <^iP^^) ( / (29a) 

?n — — oo 
2tt 







■m I I 5 



Vm— — oo 



where 



(29b) 



(30) 



Choosing either the first or the second inequality, we ob- 
tain the inequality ([^5]) either for a > /3 or for a < (3. 

The uncertainty relations ((26)) and ([45]) also hold for 
the phase and the occupation number of a mode of radi- 
ation. In this case, the Fourier expansion contains 
only the terms with m > 0. 



V. UNCERTAINTY RELATIONS FOR A^-LEVEL 
SYSTEMS 

For quantum systems described by vectors in the A^- 
dimensional Hilbert space the analog of the uncertainty 
relation for the Renyi entropies is 




>lniV, (31) 



where pk — \o,k\^ , pi — and the amplitudes 5^ and 
a; are connected by the discrete Fourier transformation 



N 



ak 



^= V exp(27rifc I IN) ai . 



(32) 



The complex numbers 5,^ and a; can be interpreted as 
the probability amplitudes to find a particle in the dis- 
cretized momentum space and position space [35| . but 
they can also be viewed as amplitudes in a general ab- 
stract iV-dimensional Hilbert space. The uncertainty re- 
lation ([3T|l is saturated for the states that are localized 
either in "position space" (only one of the amplitudes a/ 
is different from zero) or in "momentum space" (only one 
of the amplitudes is different from zero). Like in the 
case of the uncertainty relations for the angle and the an- 
gular momentum, the bound does not depend on a and 



j3. The absence of the Planck constant is again due to a 
cancellation — it would reappear if I and k in (j32p are 
given the physical dimension of length and momentum. 

The proof of the uncertainty relation (pij) proceeds 
along similar lines as the proof of ([7]) but now we invoke 
a different known inequality — the (p, (7)-norm of the dis- 
crete Fourier transform (cf., for example, Ref. ^3^) 



M\p<N-^ -^\\a\\q, \\a\\j,<N-^--^\\h\\ 



(33) 



Uncertainty relations for iV-level systems involving the 
{p, (7)-norms of the discrete Fourier transform were es- 
tablished in Ref. [s^l but they have not been used to 
derive the uncertainty relations for the Renyi entropies. 

For a system composed of two subsystems described 
by state vectors in the N and M dimensional spaces the 
bound on the right hand side of the inequality is equal to 
In(A^M) — In A^ + lnM because the dimensionality of the 
Hilbert space of the composed system is NM . The same 
result is obtained for two totally independent systems of 
dimensionality N and M because the Renyi entropy is 
additive for independent probability distributions. This 
means that the uncertainty relation is already saturated 
by separable states and allowing for entanglement does 
not make any difference. 



VI. UNCERTAINTY RELATIONS FOR MIXED 
STATES 



The uncertainty relations for the Renyi entropies hold 
also for all mixed states. This result is not obvious be- 
cause the Renyi entropy is not a convex function [1 of 
the probability distributions for all values of a. Hence, 
the terms on the left-hand side of the uncertainty relation 
([7]) may decrease as a result of mixing. However, I shall 
prove now that the inequalities (|16p that were the start- 
ing point in the derivations hold also for mixed states. 
This follows from the integral form of the Minkowski in- 
equalities [3^, namely 



dV\J + g[^\ < dV\fr 



dV\gr 



(34a) 



dV\ff] + dV\g\n < dV\f + gf 



(34b) 

where / and g are nonnegative functions and the pa- 
rameters a and P satisfy the condition a > (3. Substi- 
tuting in the first inequality for the functions / and g 
the weighted densities in momentum space / = Api(p) 
and g = (1 — X)p2{p) and in the second inequality the 
weighted densities in the coordinate space / = \pi{x) 
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and g = (1 — X)p2{x), we obtain 

o 

dp{xpi{p) + {i-x)p2{p)r 
<x( f dppi(p))"V+(i-A) I / dpp2{p)r 



A / dxp,ix)f] +(1-A)(/ dxp2ix)f 



< / dx{Xpi{x) + {l~-X)p2{x)f 



(35a) 



(35b) 



Comparing these results with the weighted sum of in- 
equahties (|16ap for pure states 



xi^j dpip,{p)rj +(i-A)(/ dp{p2{p)r 

<n(a,(3)x(^J dx{Xpi{x)fy 

+ n{a,l3){l-X)(^j dx{Xp2{x)fy , (36) 
we extend the inequality (|16ap to mixed states 

o 

dp{xpi{p) + {i-x)p2[p)r 

Xj 

<n{a,l3)( I dx{Xpi{x) + {\-X)p2{x)fy. (37) 



In the same manner we can extend the inequahty (|16bp 
to mixed states. 

Once we have proven the vahdity of the inequaUties 
pop for mixed states, we may proceed as before to prove 
the vahdity of the the Renyi uncertainty relations ([7]) for 
mixed states. Similar arguments can be invoked to prove 
also the uncertainty relations (pS)) and (pij) for mixed 
states. 



On the left-hand side of this inequality we have what 
might be called the continuous or integral versions of the 
Renyi entropies. To derive this mathematical inequal- 
ity, I have dropped h in the definition ^ of the Fourier 
transform. This inequality has been also recently inde- 
pendently proven by Zozor and Vignat [s^. Analogous 
relations for the continuous Tsallis entropies for x and p 
were obtained by Rajagopal 28]. 

In the limit, when a ^ 1, /3 — s- 1, we obtain from the 
inequality psp the entropic uncertainty relation in the 
form 



dp p[p)\np{p) — I rfa; p(a;) In p(a;) > ln(e7r) (39) 



that had been conjectured by Hirschman 14011 a nd later 
proved by Bialynicki-Birula and Mycielski [41| and by 
Beckner [3l| . The inequalities ([55]) and ([55)) are saturated 
by the Gaussian probability distributions. 

For wave functions defined over an n-dimensional 
space, the bound on the right-hand side in and ([55]) 
is just multiplied by n, as in the previous formula (|25|) . 
Therefore also in this case, like in the finite-dimensional 
case, the uncertainty relations are already saturated by 
separable states. 

In a similar fashion we can derive the uncertainty re- 
lation for ip and that does not involve the resolution 
5tf. 



dLp [p{ip)]'- 



> ln(27r). 



(40) 



where pm = |cmP and p{(p) — \il;{(p)\'^ . In the limit, 
when a ^ 1 and /? 1, we obtain the mathematical en- 
tropic uncertainty relation for the angle and the angular 
momentum derived before ^] 

-V'pmlnp™- / dip p{(p) In piip) >\n{2TT). (41) 

The inequalities and (HU, like their discrete coun- 
terpart ([26)) . are saturated when the Fourier series (|28)) 
has only one term. 



VII. UNCERTAINTY RELATIONS FOR 
CONTINUOUS DISTRIBUTIONS 



VIII. SYMMETRIZED RENYI ENTROPIES 



There exist also purely mathematical versions of the 
uncertainty relations that do not involve the experimen- 
tal resolutions Sx and Sp of the measuring devices. By 
taking directly the logarithm of the inequality (|16p. and 
using the relations between a and /?, we arrive at 



1 



In 



dp[p{p)r 



1 



1-/3 



In 



dx [p{x)f 



> 



1 



■In^- 



2(l-a)-"7r 2(1^ ^^^^ 



In the uncertainty relations for the Renyi entropies the 
parameters a and (3 appear always in conjugate pairs. 
This observation suggests the introduction of the sym- 
metrized Renyi entropy TLs defined as follows 



Hp), 



(42) 



where a and /? satisfy the conditions (fT2| and they are 
related to the parameter s through the formulas 



1 



1 - s' 



f3 



1 



-1< s < 1. 



(43) 
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The symmetrized Renyi entropy Tis is a symmetric func- 
tion of s and for s = it becomes the Shannon entropy. 
The uncertainty relations expressed in terms of the sym- 
metrized Renyi entropies have the form 

They are obtained by taking half of the sum of the in- 
equality ([7]) and the inequality obtained from ([7]) by inter- 
changing a and /3. The same symmetrization procedure 
can be applied to all other uncertainty relations derived 
in this paper. In particular, we obtain 

T^{m.)+-hM>_iJ_P^ (45) 

ZTT 

Analogous symmetrized versions of the uncertainty re- 
lations for the Tsallis entropies were introduced also by 
Rajagopal [2^] . 

In contrast to the inequalities that contain the Renyi 
entropies Ha and Hfj, in the uncertainty relations that 
contain the symmetrized entropy the same measure of 
uncertainty is used for both physical variables. This 
is clearly a desirable feature but it remains to be seen 
whether the symmetrized Renyi entropy (|42p is a useful 
concept outside the realm of the uncertainty relations. 

Different uncertainty relations in which the same mea- 
sure of uncertainty is used for both variables follow from 
the fact that the Renyi entropy is a nonincreasing func- 
tion of a. For example, for the position and momentum 
we obtain 



>-ln/3-^ln(2/3-l)-ln(^), (46) 



where 1 > /? > 1/2. 



IX. CONCLUSIONS 



I have shown that quantum mechanical uncertainty 
relations for canonically conjugate variables can be ex- 
pressed as inequalities involving the Renyi entropies. The 
simplicity of these relations indicates, in my opinion, that 
the Renyi entropy is an apt characteristic of the uncer- 
tainties in quantum measurements. A significant feature 
of the uncertainty relations ([7]), ©, ([^5]) . and ([^5]) is 
the appearance of the resolving power of the measuring 
apparatus. Since the Renyi entropy is an extension of 
the Shannon entropy, the new uncertainty relations gen- 
eralize the entropic uncertainty relations derived before. 
The formulation of the uncertainty relations in terms of 
the Renyi entropies seems to indicate that a symmetrized 
version of the Renyi entropy (|^^ might be a useful con- 
cept. 
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